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Abstract 

Three concurrent validity studies were conducted on the relation- 
ship between perf orxnanccs on behavioral measures of written expression 
and performances on standardized achievement measures of written ex- 
pression. Results of correlational analyses are reported for five 
behavioral measures, two standardized measures, and the Developmental 
Sentence Scoring System. Considerable evidencv-^ was obtained for the 
validity of all behavioral measures except T-units as indices of 
achievement in written expression- Additional comparisons indicated 
that both educational status (LD resource program vs. regular program) 
and grade level were related to performance on the four validated be- 
havioral measures. ,Two to three minute writing samples were found to 
be of sufficient length to produce valid indices of written expression 
using the behavioral measures. The potential usefulness of these 
measures to monitor student growth and evaluate the effectiveness of 
interventions is discussed . 
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Introduction 

The research reported here was conducted as part of a project 
that has as its purpose developing formative evaluation systems for 
teachers to use in improving learning disabilities service programs 
in written expression. The primary assumptions upon which that research 
project is based are: 

1) that the success of learning disabilities services is 
defined primarily by the extent to which those services 
improve the academic and social behavior goals of the 

i dividual students served, 

2) that teachers can increase the success of learning disa- 
bilities services by systematically measuring student 
progress toward achievement of program goals and then 
adjusting student programs to improve that progress, 

and 

3) that the technology presently available for teachers to 
use in measuring student progress and adjusting programs 
based on measured progress is either not sufficient or 
has not been sufficiently tested. 

The particular part of the research project described here was 
conducted to answer a first and critical question that is raised when 
developing a formative evaluation system in written expression: what 
student performance data can be routinely and easily obtained that 
validly index achievement? The question arises because, for several 
good reasons, commercially prepared standardized tests of written 



expression ordinarily used to assess achievement cannot be used 
routinely in a formative evaluation system to monitor performance. 
First, commercially produced standardized tests take too much time 
to administer. Second, an insufficient number of ecuivalent forms 
is available for any test to be used in the repeated measurement of 
performance required for formative evaluation. Third, the cost of 
using achievement tests repeatedly is prohibitive* 

The development of measurement procedures that can be incorporated 
relatively easily into the daily routine of most teachers working in 
learning disabilities programs is deemed desirable if intensive monitoring 
of program effects on student performance is to occur. The importance of 
intensively monitoring program effects is that such monitoring enables us 
to more precisely determine the appropriateness of services provided to 
individual students. Given the requirement in P.L. 94-142 •(Federal Register, 
1977) that each handicapped student be provided an ''appropriate educational 
program" and our current inability to r.iagnose and prescribe effective 
programs (Arter & Jenkins, 1978), continuous evaluation of a student's 
program is the only way to achieve substantive compliance with the law 
(Deno & Mirkin, 1980). 

Beyond compliance with the law, research on the use of intensive 
repeated measurement in formative evaluation of instruction has already 
yielded evidence bearing on its potential b enefits (Bob^innon, 1975; 
Crutcher & Hofmeister, 1975; Frumess, 1973; Lovitt, Schaff, & Sayre, 
1970; Mirkin & Deno, 1979). The research findings are isclat:id, however. 
The research and development program of which the present studies are a 
part was designed to systematically construct formative evaluation 



8 



procedures for learning disabilities programs that specify: 



(1) 



What behaviors to measure when improved writing pro- 



ficiency is an lEP goal- 



(2) 



How to repeatedly measure those behaviors reliably. 



(3) 



Who should administer the measurement procedures. 



(4) 



How often measurement should occur • 



(5) 



How to obtain data most efficiently. 



(6) 



How to use repeated measurements of student performance 



to increase intervention effectiveness • 



The strategy employed in the present research was first to review 
available literature on written expression, to identify behaviors that 
are commonly used to assess achievement in this academic domain; second, 
to develop measurement procedures for taking data on those behaviors; and 
third, to determine the reliability and validity of the measures by cor- 
relating the scores obtained on them with scores from standardized measures 
of written expression that are highly respected, and technically adequate 
with respect to their psychometric properties . 

To be considered for inclusion in a formative evaluation system 
the developed measures had to fulfill the following criteria: 

(1) They must be valid with respect to widely used measures 
of achievemant in written expression. 

(2) They must be immediately sensitivfc^ to the effects of 
relatively small adjustments made in (a) instructional 
methods and materials, (b) motivational techniques, and 
Cc) administrative arrangements (e.g,, adjustments in 
grouping, setting for instruction, teacher/ tutor , 
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time of instruction, etc.)- 

(3) They must be easy to administer by teachers, parents, 
and students. 

(4) They must include many parallel forms that are frequently 
administrable (daily, if necessary) to the same student - 

(5) They must be time efficient , 

(6) They must be inexpensive to produce. 

(7) They must be unobtrusive with respect to routine Instruction. 

(8) They must be simple to teach to teachers, parents, and children* 
Our hope is that regardless of personal philosophical, theoretical, 

historical, and current situational constraints, those responsible for 
ensuring the qua.'ity of learning disabilities services will continu- 
ously evaluate the impact of those seirvices on the academic and social 
behaviors of their individual students- The measurement procedures 
that are described here are an important first step in the development 
of such an evaluation system. 



Review of tha Literature 

A wide array of approaches to measuring a child's performance 
in written discourse is currently available. The methods range from 
formal achievement testing, to analysis of grammatical and syntactic 
structures, to counting such basic written units as words. In this re- 
view of the literature on the measurement of written exprassion, these 
approaches will be described briefly and appva-f^ed for their appropriate- 
ness in formative evaluation procedures. 

Aside from the .traditional assignment of letter grades to written 
essays, achievement testing is probably the most popular approach to 
assessment of x^'itlng performance. Twsts such as the Stanford Achieve- 
ment rest (Madden, Gardner, Rudman, Karlsen, & Merwln, 1978), SRA Achieve- 
ment Series: Language Arts CThorpe, Lefever, & Naslund, 1968), and the 

Metropolitan Achievement Tests (Durost, Blxler, Wrlghtstone, Prescott, 

1 

6t Balow, 1?71) employ varying subtests to evaluate a student's "language 
ability," "punctuation," "spelling," "grammatical structure," "sentence 
sense," "word usage," and "capitalization." The format of achievement 
test items is usually forced-choice, often requiring multiple-choice 
responses, and at times, completion or underlining. Although the achieve- 
ment tests are often well standardized, with reported validity coeffi- 
cients and sufficient reliability, they do not meet many of the require- 
ments of a formative evaluation system which entails the frequent moni- 
toring of a wtudent's progress. 

Several limiting factors make standardized achievement tests inappro- 
priate for formative evaluation of written expression. First, the behavior 
sample in these achievement tests is limited and Is dependent on reading 
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skills. In fact^ it cculd be argued that many of the achievement tests 
that purport to measure "written expression** primarily measure reading 
skills rather than language development or writing skills. A fairly new 
achievement test that do^s employ a written production task is Hammill and 
Larsen*3 (1978) Test of Written Language (TOWL) . Their incorporation 
of the student's written sample in the assessment of writing skills 
appears to be a promising alternative to forced-choice items. 

A second limiting factor in using achievement tests for formative 
evaluation is the duration of the tests. Achievement tests clearly are 
desig led for infrequent administration, with many taking from 30 to 60 
minutes for completion. 

Third? item samples on the various subtests are often small, reducing 
the likelihood that the subtests will be sensitive to changes in the in- 
dividual's performance. As stated before, formative evaluation systems 
must be sensitive to change in performance. 

There have been numerous unique attempts to measure written ex- 
pression that do not fall into the achievement test domain. Hunt's 
(1965, 1966) Minimal Terminable Unit or T-unit length, for example, is 
a measure of syntactic complexity. A growing body of research demon- 
strates that the T-unit is a valid measure of written expression (Perron, 
1977), is reliable (Dixon, 1972), and increases with age (O'Donneli, 
Griffin, & Norris, 1967; Veal, 1974). Initially, the T-unit length ap- 
pears to ba a promising candidate for use. in a formative evaluation sys^- 
tem. A major problem with T-unit length, hov/ever, is its probable in- 
sensitivity to change. Since the average T-unit length ranges from 
only one word in Grade 1 to 15 words in Grade 12, weekly or monthly 
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changes in performance would be difficult to discern* 

Related to Hunt's T-units are Dixon's (1972) free modifiers and 
Golub and Kidder's C1974) S^mtactic Density Score. The latter measure 
incorporates words per T-unit, subordinate clauses, words per main 
clause, number of modals,' number of prepositional phrases, and number 
of possessive nouns and pronouns into an equation that yields a per- 
formance score. Dixon's free modifiers and the Sjmtactic Density Score 
both correlate highly with criterion measures of written expression. 
However, both are difficult to score* 

The Developmental Sentence Scoring System (Lee & Canter, 1971), 
originally created to measure syntactic acquisition and the child's 
knowledge of grammatical rules in oral language, has been adapted for 
indexing written discourse. The scoring procedures consist of eight 
scales that measure the student's use of noun modifiers, personal pro- 
noaas, main, verbs, secondary verbs, negatives, conjunctions, interro- 
gative reversals, and WH-questions. Rubin, Buium, and Balow (1975) analyzed 
the grammatical sophistication of written compositions of nine-year-old 
children with this measure and found that the index generally followed a 
developmental continuum. Despite the measure's appeal, however, the com- 
plex scoring system makes it much too laborious for use in a formative 
evaluation system. 

A wide variety of subjective measuring scales also have been de- 
veloped to measure performance in writing (Diederich, 1964; Mullis, 1976; 
Stahl-, 1974). The scales are subjective in that, without detailing spe- 
cific criteria, the judge is asked to rate students' written compositions. 
In the Primary Trait Scorins System (Mullis, 1976), for example, the 



EKLC 



13 



I 

8 

judge must rate the student's composition on a scale from 1 to 4 on the 
categories of "fantasy," "insights," "entry world of picture," "dialogue," 
"point of view," and "tense." The Diederich Scale (1964) is similar in 
that the judge rates the writer as low, middle, or high on "quality and 

I 

development of ideas," "organization," "style," "wording," "grammar," 
"punctuation," "spelling, and "handwriting," Likewise, Stahl's (1974) 
Feature Analysis rates thu writer on "order," "principle of selection," 
"syntax," "balance," "organization," "connectives," and "openings." In 
all, the subjective scales may be praised for their attempt to measure those 
dimensions of written discourse that are difficult to quantify precisely. ' 
However, the scales may not serve well to continously monitor student 
performance, since validity and reliability data are difficult to obtain 
for ratings that are so ambiguously defined. 

Carroll, Davies, and Richman (1971) have provided a unique approach 
to evaliiating writing skills that involves determining the maturity of 
the student's word choices. These authors developed the Standard Fre- 
quency Index as a measure of mature word usage. For Carroll et al., the 
frequency with which a word appears in the English language is inversely 
related to its maturity. Thus, the use of a word that is not commonly 
used connotes maturity. Using the Standard Frequency Index, Finn (1977) 
developed a list of 220 words that do not discriminate fourth grade i:rom 
eleventh grade students on mature word usage. Finn refers to this group 
of words as the Undistinguished Word Choice List. VJhile scoring compo- 
sitions in terms of word maturity looks promising, it remains to be seen 
whether such a measure can be reliably and quickly scored, is sensitive 
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to growth, and relates to other measures of written e^cpression. Page 
(1968) does provide some evidence for this approach. He found that 
words from high school compositions that were also found on the Dale 
word list (Dale & Chall, 1948) were inversely correlated with perform- 
ance. 

Another unique way of examining written performance is to document 
the number of large words included in the composition. Page (1968) 
reported a moderate correlation between the average word length measured 
by letters and criterion measurement of written performance. Kuehnle, 
Tindal> ar.d Marston (1979) examined the compositions of 20 third-grade 
students and found that large words (seven or more letters) correlated 
•47 with creativity. 

Cloze procedures also have been used to measure written discourse 
(Nystrand, 1977). Nystrand argues that this procedure better assesses 
individual strengths and weaknesses than T-unit.^ and allows one to judge 
the syntactic, semantic, and graphic dimensions of writing. Extensive 
empirical support for this argument is absent, however. 

Research also indicates that spelling is a significant component 
of written expression (Page, 1968; Slotnick, 1972). Page (1968) found 
that the number of spelling errors was inversely correlated to perform- 
ance. Slotnick s (1972) factor anaysis of compositions written by high 
school students determined that the second most important factor was 
spelling. 

Myklebust (1965) developed a test of written language that employs 
a variety of measures of writing. His Picture Story Language Test eval- 
uates the writer on three dimensions: productivity, syntax, and quality 
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of content. Although the specific measures on all three dimensions 
appear to index development of writing skills between the ages of nine 
and 15, it is total words, a productivity measure, that may offer most 
to a formative evaluation model- This measure is obtained easily and 
can range widely across ages- Total words written, in addition, appears 
to be the most powerful discriminator between children with learning 
disabilities and those who develop normally (Myklebust, 1965). Hillerich 

(1971) agrees that total words is a potent measure and states that fluency 
is an excellent indicator of development in written language- The research 
of Brigham, Graubard, and Stans (1972) also substantiates this claim* 
These authors note that number of words written, number of different words 
written, and number of new words written, all index growth in written dis- 
course- Rubin and Buium (1974) found that total words written correlated 
highly with abstractiveness or creativity and vocabulary richness. Slotnick 

(1972) factor analyzed compositions written by high school students and 
identified fluency or total words written as the most significant factor 
contributing to written performance, accounting for 24 percent of the 
variance. Page (1968) also reported a moderate correlation between total 
words written and written performance* 

As evidenced here, there are many available approaches for measuring 
written expression- For any of these approaches to be employed in a 
formative valuation system, they must first satisfy the suggested cri- 
teria. 3 literature reviewed here suggests five measures of written 
expres .on that might be used: Hunt's mean T-unit length, Myklebust 's 
total words written in a composition, number of Large Words used, number 
of words spelled correctly, and Finn^s Undistinguished word list. 
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Three Studies of Written Expression 



Three studies were conducted to identify behavioral units in 
vnritten expression that could be measured in a formative evaluation 
system and to deteinnine the concurrent validity of these measures . 
General information on the three studies is presented first, followed 
by the specific methods and results of each study. 



Vlhen the criteria established for inclusion of a measure in a 
formative evaluation system were initially applied to those behaviors 
included in the literature on written discourse, five behavioral units 
were identified as potentially useful for a formative system. The 
measures were: T-units, words written, mature words written, large 
words written, and words spelled correctly in a written sample. 

Subjects in the three studies were asked to write compositions in 
response to a picture stimulus, story starter, or topic sentence. The 
subjects' written samples were then scored to obtain measures of the 
five behaviors- To establish concurrent validity, standardized achieve- 
ment tests of written expression were administered also, and performance 
of students in learning disability resource programs was contrasted to 
that of regular class students. Scores for the five behavioral units 
were then correlated with performance on the criterion achievement 
measures. 

Stimulus Materials 

Three procedures were employed to elicit vnritten samples from the 
subjects: a picture stimulus, story starters, and topic sentences- The 
Picture Stimulus procedure closely followed Myklebust*s (1965) Picture 
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Story Language Test. Every effort was made to adopt his criteria. In 
the course of the &tudy two pictures were used, picture X-3 from the 
Peabody Language Development Kit, Level 3 (Dunn & Smith, 1967), and the 
picture stimulus from Hammill and Larsen's (1978) Test of Written Language 
(TOWL). The stimulus picture from »:he Peabody Kit is a 21.5" by 18.5** 
colored picture depicting a young boy riding an elephant in the jungle 
accompanied by many different types of animals. In the background a 
fire rages as a helicopter hovers over it. The picture from the TOWL is 
a 3-picture sequence showing people on earth being visited by flying 
saucers J flying through space, then landing on a different planet* 

Other methods for eliciting children's writing responses included 
Scory Starters and Topic Sentences. In the Story Starter condition, 
a written stimulus vas shown and read aloud to the child. The stimulus 
sentence created a situation in which the child was asked to imagine 
himself or herself. The child was then asked to write a story about what 
happened. Topic sentences generally were shorter written stimuli for 
which the child was asked only to "write something about this.'* For all 
three stimuli the child vas asked to write for five minutes. Examples 
of story starters a-nd :.npic sentences can be found in Appendix A. 
Scoring Procedi ^ reg 

Each student's written sample was scored to obtain measures of the 
five behavioral uni' s. 

T-unie length . Scoring was accomplished according to Hunt's rules 
(1965, 1966). An example of how T-unit length was computed for written 
compositions is provided in Appendix B. 
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Mature Words , Scoring procedures were based on Finn's (1977) 
Undistinguished Word Choice List. Words written that did not appear 
on that list were circled and' totaled. Appendix C shows how composi- 
tions were scored for mature words. 

Total Words Written . Scoring involved simply counting the number 
of words written in the sample. Words did not have to be spelled cor- 
rectly. The minimum criterion for inclusion of a word was that at 
least two letters be written in sequence, except for single letter 
words (e.g., "I" and "a"). Appendix D provides an example of scoring 
on this measure. 

Large Words . Scoring involved counting the number oir words with 
seven or more letters. In later phases of research, large words ending 
in "ed" or "ing" were counted only if the root word had seven or more 
letters. An illustration of such scoring may be found in Appendix E. 

Words Spelled Correctly . Scoring written samples for spelling 
was done by checking those words spelled incorrectly and tallying the 
remaining, words. An example of this measure is provided in Appendix F. 
Criterion Measures 

To establish the concurrent validity of the measures of written 
expression, nine different criterion variables were used individually 
and in combination. 

Test of Written Language (TOWL) . Developed by Hammill and Larsen 
(1978), the TOWL was used in all three phases of investigation. The 
TOtTL consists of five subtests: Vocabulary, Thematic Maturity, Spelling, 
Word Usage, and Style. The criterion measures obtained from the TOI^ 
were the raw scores from the five subtests and the raw total of the 
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five subtests. It should be noted that four of the five subtests are 

I 

25-item scales, and therefore were equally, weighted in the raw total. 
Howevar, the Vocabulary subtest does not have a limited number of items 
and as a result students may obtain a score higher than 25 points on this 

I 

subtest. We found the range of Vocabulary scores in our sample of ** 
135 students to be from zero to 70 points. To ensure that the Vocabul- 
ary subtest was equally weighted in the raw score total, a student's 

i 

score on this measure was multiplied by a correction factor of .357 
(or 25 70). A Written Language Quotient (WLQ) with an age-scaled 
total score mean of 100 can be derived from the subtests and was al^o 
used as a criterion measure. 

Stanford Achievement Test, Intermediate I, Word Usage Subtest . 
This subtest, constructed by Madden et al. (1978) was also administered 
as a criterion measure to the subjects. The Word Usage subtest includes 
42 multiple-choice items designed to measure appropriate choice of words 
within written context. 

Developmental Sentence Scoring System . The Developmental Sentence 
Scoring System (Lee & Canter, 1971) was developed originally to describe 
syntax in oral language. In the present study it was used as a criterion 
measure of the syntactic maturity of the xcrritten samples. Appendix G 
outlines the scoring categories adopted from this approach. 

Program Placement . Since a primaiiry goal of the research was to 
develop measures useful for assessing students receiving learning disa- 
bilities services, one validity criterion is the degree to which the 
measures discriminate between students receiving LD services and those 
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not receiving such services. To this end, the performance of random 
samples of students from regular classrooms not receiving special edu- 
cation services was compared to the performance of students in LD re- 
source programs on all measures- 

Study I 

Subjects 

Participation x-'as solicited from two public elementary schools 
in Minneapolis- Twenty-eight children were randomly selected from those 
schools. The children were enrolled in grades three through six and 
ranged In age from seven to 11 years- Half were boys and half were girls. 
Twelve of the 28 children were receiving learning disabilities services 
in resource programs for approximately one hour per day* Sixteen chil- 
dren were in regular classes all day- 
Procedure 

Testing was conducted by three graduate research assistants, 
trained at the Institute for Research on Learning Disabilities at the 
University of Minnesota- Each child was tested individually and data 
collection required approximately 55 minutes per child. 

Each child was presented a Story Starter developed by Institute 
staff and the oicture stimulus from the Peabody Language Development Kit. 
A copy of the Story Starter may be found in Appendix H. 

For the Picture Stimulus condition the examiner presented the stu- 
dent with the response form and two pencils- He or she then read the 
following instructions: 

Today I want you to write a story* First, I want you to 
look at this picture and think about what is happening in 
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it. Then I want you to write a story about what is happen- 
ing in this picture. You will have a minute to think about 
the story you will write and then have five minutes to write 
it. When I say, "please start writing," you mo.y begin. 

For the Story Starter condition the instructions were similar. 

The examiner recited the following instructions: 

I want you to write another story. I am going to read a 
sentence to you first, and then I want you to write a short 
story about what happens. You will have a minute to think 
about the story you will write and then have five minutes 
to write it. When I say "please start writing," you may 
begin. 

In both writing situations the student was given five minutes to 
finish his or her ccmposition. In addition, the examiner recorded the 
amount of time the student actually spent writing. This procedure 
allowed examination of the measures as rate variables. 

All students also were administered the TOWL. Administration pro- 
cedures outlined in the TOWL's instructional manual were followed 
closely. The duration of the test was approximately 40 minutes. 
Results 

All information collected was analyzed by computer at the Univer- 
sity of Minnesota Computer Center. Statistical Package for Social 
Sciences (SPSS) was used exclusively for all statistical analysis. 

Analyses of the Study I results focused on the correlations be— 
tween scores for tha five behavioral units in written expression and 
scores derivecl from the TOWL subtests, A single score was obtained 
for each of four of the behavioral units and two scores were obtained 
for Words Written - total words written, and rate. This latter score 
was created by dividing the total number of words written by the num- 
ber of minutes each student wrote during the given five minute interval. 



Picture Stimulus , The correlational results for the measures ob- 
tained from the picture stimulus are presented in Table 1. As inspection 
of Table 1 reveals, the highest correlations between scores for the 
behavioral units and scoreiS on the TOWL were found for Words Spelled 
Correctly (.08 to .88), Total Words Written (.65 to .82) and Mature Word- 
(.56 to .79). Mean T-unit length generally was not associated with per- 
formance on the TOWL, while correlations between rate of words written and 
the TOWL were relatively low. 

Insert Table 1 about here 

The discrepancy obtained in correlations of Total Words Written and 
Rate of Words Written with the TOWL is of interest. Since the content 
of the two measures is highly similar, one might expect approximately the 
same correlations with the criterion achievement measure. Further analy- 
sis, however, revealed that lower performing students would often write 
for only a few seconds and then quit. The result was that their rate of 
performance was similar to students wpo had scored high on the achievement 
measures. It appears that, in t:his situation, the rate measure masked the 
differences between low and high functioning children. Total Words 
Written seems to provide a finer discrimination of writing skills. 

Story Starters . An analysis of the relationships between scores 
on written compositions cued by Story Starters and the criterion mefasures 
was also conducted. Triese results are presented in Table 2. 



Insert Table 2 about here 
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The pattern of correlations obtained with the story starter was 
quite similar to that obtained with the picture stimulus. The obtained 
coefficients for Mean T-unit length and Large Words appear to have in- 
creased slightly; however^ the coefficients for Mean T-T..nlt length 
(.11 to •26) are still low. The obtained correlation coefficients for 
the other measures are smaller than in the Picture Stimulus condition, 
with correlations for Words Spelled Correctly ranging from .45 to ,73, 
Total Words Written ranging from ,41 to .70, Mature Words ranging from 
•41 to .71, and Large Words ranging from .45 to .72, 

In all, the results of Study I offered preliminary indications of 
the validity of some of the formative measures and provided impetus for 
the further investigation of these measures in Study II. 

Study II 

In addition to replicating Study I, Study II was designed to in- 
vestigate three questions important to the development of the formative 
measures. First, to examine the possibility that the results of Study 
I were specific to the Story Starter used, student performances on 
three independent story starters and topic sentences were analyzed to 
determine whether student performance on these samples were significantly 
different. Se:ond, to further exp].ore the types of writing stimuli 
that might be used as writing cues, the Topic Sentence was included as 
a test stimulus. Third, to ascertain the wri!:ing time necessary to 
obtain a technically adequate measure, the perforLiance of subjects at 
varying time intervals was analyzed • 
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Subjects 

Twenty-eight children were randomly selected from an elementary 
school in the Twin Cities metropolitan area. The sample was composed 
of 16 males and 12 females, ranging in grade placemen: from grade three 
to grade six, and in age from eight to 12 years. Fouv of the 28 chil- 
dren were receiving learning disabilities services in a resource pro- 
gram for approximately one hour per day; the remaining 24 children were 
in regular classes all day. 
Procedure 

Two graduate research assistants and two undergraduate students 
from the College of Education at the University were trained to adminis- 
ter the tests. Each child was tested in a small group of three or four 
students. Data collection lasted approximately 55 minuter per group. 

Each child was given a Story Starter that had been randomly selected 
from a group of three Story Starters. The picture stimulus from the 
Peaboay Language Development Kit was also used with a]l students. In 
addition, the students were randomly assigned to write about one of 
three Topic Sentences. Children had five minutei^ to write compositions 
in each of the three stimulus conditions. On all three compositions, 
the examiner determined how far the student had written at the end of 
one minute, two minutes, three minutes, and four minutes. Copies of 
the Story Starter and Topic Sentences employed in this study may be 
found in Appendix I. 

The TOWL was used as one of the validation criteria. Subtest 8 of 
the language section of the Stanford Achievement Test, Intermediate I 
(Madden et al. , 1978) also was administered to all subjects. Except 
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for the additional procedure of marking one minute intervals on the ^ 
written compositions, instructions to the students were identical to 
Study I specifications. Order of presentation of stimulus materials 
is outlined in Appendix J. 

I 

Scores for the written samples were obtained using the same scor- 
ing procedures as in Study I. An additional modified Large Word trcore 
was obtained by omitting words with "ed" and "ing" endings in the 

I 

scoring of large words. Root words had to contain seven or more letters 

to be counted as large words. 

Results 

Story Starters , To answer the question as to whether students per- 
form Inconsistently on different Story Starters, a one-way analysis of 
variance was conducted. Results indicated that there were no signifi- 
cant differences among the three story starters for Total Words Written 
(F = 1.1, £ .348), Mature Words Written (F = .229, £ = .797), and 
Words Spelled Correctly (F = .536, £ =^ .592). 

Correlation coefficients obtained when using a Stor^ Starter stim- 
ulus are presented in Table 3. The correlations obtained across cumula- 
tive minutes of writing are included in the table. As can be seen, 
the obtained coefficients between scores from the writing sample and 
Total Raw Score on the TOWL parallel Study I correlations, except that 
the coefficient for Large Words is somewhat higher. Of related interest 
is the fact that littJ.e difference was obtained between the coefficients 
for Large Words and Large Words Modified. The coefficients for Mean 
T-unit Length are higher, and in contrast to Study I, they are signifi- 
cant. Still, the highest coefficients obtained are for Mature Words 
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(•82), Total Words (.79), and Words Spelled Correctly (.78). 



Insert Table 3 about here 

The Stanford Word Usage Subtest correlations provide a picture 
simular to those obtained from the TOWL. The relative size of the co- 
efficients for the different scoring procedures remains essentially 
the saaie. Coefficients with the Stanford Word Usage Subtest are lower 
than with the TOWL in every case except for Large Words Modified, 
where they are somewhat higher. 

Inspection of Table 3 with respect to ihe question of sample dura- 
tion reveals mean correlations that range from .60 for a one minute 
writing sample to .67 for a five minute sample. Sample duration appears 
to influence coefficient size, but only slightly. The increase in co- 
efficients from .60 at one minute to .65 at three minutes may be prac- 
tically important, but little difference exists among coefficients for 
three, four, and five minute samples • 

Topic Sentence . / To determine whether significant differences 
exist among various Topic Sentences, a one way analysis of variance 
was conducted. Again, the results indicated no significant differences 
among Topic Sentences 1, 2, and 3 f or the various measur&s i Total 
Words Written ( F = .26, £ = .775), Mature Words Written (F = .45, £ = 
•644), and Words Spelled Correctly ( F = .32, £ = .728). As may be seen 
in Table 4, the pattern of correlations for Topic Sentences is similar 
to the pattern of coefficients presented for Story Starters. Again, 
Total Words Written, Mature Words, and Words Spelled Correctly offer 
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the highest coefficients, For the duration data, the coefficients are 
virtually identical to the Story Starter correlations • Again, there 
is essentially no difference between three, four, and five minute 
samples. 

— -1 — — — — — — — — — — — — 

Insert Table 4 about here 

Picture Stimulus . Correlation coefficients for the Picture Stimu- 
lus condition (see Table 5) were slightly higher when compared to Story 
Starters and Topic Sentence data, for all formative measures of written 
expression. Nonetheless, the pattern of correlations is similar, 
Mature Words, Words Spelled Correctly, Total Words Written, as well as 
Large Words, showed high correlations (above -70) with both the TOWL 
and the Stanford. Again, there appeared to be little difference between 
written samples of three, four, and five minute durations. 

Insert Table 5 about here 

Relationships among the various writing formats . To compare per- 
formance among the different stimuli (i.e.. Story Starter, Topic Sen- 
tence, and Picture Stimulus), an intercorrelation matrix was generated. 
The results, presented in Table 6, suggested a high degree of correspon- 
dence between Story Starters and Topic Sentences, Story Starters and 
Picture Stimulus, and Topic Sentences and Picture Stimulus, on all 
formative measures except Large Words x^itten. 

Insert Table 6 about here 
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However, high correlations cannot be interpreted to mean that 
the performance of students across the three measures is equivalent. 
This question may be resolved by examining the mean performance of the 
28 elementary students on the three formative measures. These scores, 
presented in Table 7, reveal little difference in the performance of 
Jvtudents when the type of written stimulus is considered. To substan- 
tiate this claim, a repeated measures analysis of variance was computed 
for each of the three formative measures in Table 7. The results indi- 
cated no significant differences in performance on Total Words Written 
( F = .98, .381), Mature Words ( F = .78, £ = .465), and Words Spelled 

Correctly ( ^ .80, .456) across the three stimulus formats. 

Insert Table 7 about here 



Study III 

Subjects 

Eighty-two children were randomly selected from five elementary 
schools in the Twin Cities area. The 42 males and 40 females were in 
grades three through six and ranged from seven to 11 years old. Thirty- 
one of these children were in learning disability resource programs. 
Procedure 

Study III was a replication of Study II with two modifications. 
First, the Developmental Sentence Scoring System (DSS) was employed, in 
addition to the TOWL, to provide supplementary evidence for validation. 
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The DSS can be used to measure syntactic maturity and, while too complex 
for routine use in formative e* rluation, was useful as a criterion for 
establishing concurrent validity* Sample size for Study III was increased 
substantially as well, co ensure reliability of the findings. 

Procedures were again similar to those in Studies I and II. Sub- 
jects were presented a Story Starter, Topic Sentence, and a Picture 
Stimulus and given five minutes in which to write a composition. Copies 
of the Story Starter and Topic Sentence may be found in Appendix K. 
Examiners also noted the subject's progress at the end of each minute. 
Results 

Scoring procedures for the written samples were the same as for 
Study II. In addition, samples were scored for number of correct Letter 
Sequences. While several of the other scoring procedures apparently 
yield valid data, they may not be sensitive to growth in low functioning 
students in learning disabilities program who may only be writing letters. 
An illustration of how this measure was used to score a written composi- 
tion is given in Appendix K. 

Since Study II results revealed no clear differences in the pattern 
of correlation coefficients among the three types of stimuli, only the 
results for writing samples obtained using Story Starters are presented 
here. Table 8 provides the validity data with respect to the DSS. 
Analyses that include the TOWL scores are reported in the section where 
data from all three studies are combined. The correlation coefficients 
in Table 8 reveal that the production measures (i.e. , Total Words 
Written, Words Spelled Correctly, and Letters in Correct Sequence) 
correlated highest with the criterion of syntactic maturity as measured 

30 
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by the DSS, The coefficients for types of words (i.e., Large Words, 
Large Words Modified, and Mature Words) were lower than in previous 
studies particularly for Large Words and Large Words Modified, Mean 
T-unit length also was quite low when compared to the other formative 
measures • 

Insert Table 8 about here 

Analysis of the data for different sample durations again revealed 
little difference among three, four, and five minute writing samples. 
The coefficients for one minute samples were substantially lower. 
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Combined Sample Results 

To gain power in the statisJiical analysis, data from the three 
studies were pooled where possible. Combining sample data was possible 
for three reasons. First, all subjects were randomly selected from the 
same grades; second, all subjects wrote a five-minute composition from a 
Story Starter; and third, all subjects were administered the entire Test 
of Written Language. A particular advantage gained from combining the 
sample data was the opportunity it afforded to contrast the performance 
of students in learning disabilities programs with regular class students. 
In addition, pooling the data enabled more reliable estimates of grade 
level performance. 

Table 9 summarizes correlations among the dependent measures and 
the subtests of the TOWL. The relative strengths of the correlations 
between the scores from the writing samples remained the same for the 
combined sample as for the separate studies. Large Word coefficients 
were consistently smaller than those for the other scoring procedures. 
However, the magnitude of all coefficients appeared to be slightly lower, 
perhaps as a function of technical problems in pooling and analyzing data 
across the three studies* The correlational data from the combined sam- 
ples substantiate the validity of Total Words Written, Mature Words, 
Words Spelled Correctly, and Letters in Correct Sequence as measures 
of written expression. 

• Insert Table 9 about here 

c 

To provide additional clarity concerning the relationships between 

scores from the writing sample and the total raw score on the TOWL, scat- 



tergratns were created for Mature Words, Total Words, Words Spelled 
Correctly, and Correct Letter Sequences • The scattergrams are pre- 
sented in Figures 1, 2, 3, and 4. 

Insert Figures 1-4 about here 

Inspection of the scattergrams reveals a fxmctional ceiling on 
the TOWL at a raw score of approximately 80. No such ceiling was 
apparent on the scores for the x^riting sample. A floor does not exist 
for any scores except, perhaps, Mature Words, On technical grounds 
the ceiling on the TOWL is important because it may attentuate the cor- 
relations and explain the somewhat higher correlations between scores 
for written samples and the DSS obtained in Study III. 
LP Program Placement as a Criterion 

A particularly important criterion for establishing the concurrent 
validity of the different formative scoring procedures for use in the 
formative evaluation of learning disabilities is the extent to which 
the scores are consistent with program placement. Table 10 presents 
comparative data for both groups. Validity was examined with respect to 
mean differences between groups. As can be seen, mean differences existed 
between the groups by factors ranging from 1.5 to 2.0 times for Total 
Words Written, Mature Words, Words Spelled Cor rectly, and Letters in 
^Correct Sequence. All differences were statistically significant, demon- 
strating their power to reliably discriminate between children from regu- 
lar and resource classrooms. Besides supplying additional evidence of 
internal validity for the dependrnt- measures, these data suggested that 
the formative evaluation measures might be employed successfully in the 
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assessment of children with learning disabilities. 

Insert Table 10 about here 

A question of related interest is how samples from regular and LD 
programs compare with respect to the pattern of correlations between 
the various formative measures and performance on the TOWL. Those cor- 
relatiois are contained in Table 11. 

Insert Table 11 about here 

The mo^t obvious difference between samples was in the relative 
strength of the correlations. In every subtest comparisor*, the obtained 
coefficient for the LD program sample was higher than that for the regu- 
lar class sample. This finding held for the correlations with Total 
Score on the TOWL as well. The most evident pattern in the correlations 
suggested that letter and word production was a better discriminator 
for the LD program sample than for the regular program sample. 

Interpretation of the comparative correlation patterns is difficult. 
By extracting the LD program sample from the total, the distributions of 
scores are radically altered. As is illustrated in Table 12, students 
samples from Grades 4, 5, and 6 did not differ as much from one another 
as they did from students in Grade 3, 

Insert Table 12 about here 

When the data in Tables 13 through 16 are examined, it becomes 
clear that the relative difference in performance between third and 
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sixth grade students was muzh greater for the LD program sample than 
for the regular program sample. Further, on each of the scores from the 
writing sample. Grade 6 students in LD programs scored almost identi- 
cally to Grade 3 regular class students • 

Insert Tables 13 - 16 about here 

One way ANOVAs were conducted to determine whether the differences 
among student performance for the various grades were significant. The 
main effects for grade level were significant for all scores from the 
writing samples. These results are given in Tables A to D in Appendix L. 

Two way ANOVAs were conducted to examine the joint contribution of 
grade level and educational status to the total variance of scores. 
For the dependent measure Total Words Written, both main effects were 
highly significant (grade: F = 10.4, .001; educational status: * 

F = 23.1, £ = .001). The interaction vas nonsignificant (F = 1.0, 
2. ^ •359), suggesting that each factor's contribution to the variation 
in Total Words Written was unique. 

The measures of Words Spelled Correctly, Mature Words, and Letters 
in Correct Sequence behaved similarly, with significant main effects 
for grade level and educational status and no interaction effect. These 
results are provided in Tables E to H of Appendix L. 

The results of these analyses indicated that both educational status 
and grade level were uniquely related to performance on the behavioral 
measures. This suggests that the measures of written expression developed 
for formative evaluation accurately reflect the true level of performance 
in this academic area. 
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Discussion 

The results of the research presented here provide an ample 
empirical base for constructing measures to be used in the formative 
evaluation of learning disabilities interventions designed to improve 
written expression. The answers to the questions raised earlier con- 
cerning what behaviors to measure and how these behaviors can be meas- 
ured routinely, validly, and efficiently, seem straightforward. Among 
the behavioral units Investigated, Total Words Written, Words Spelled 
Correctly, Correct Letter ' Sequences, and Mature Words appear to be 
strongly and consistently related to the criteria used - achievement 
tests. Developmental Sentence Scoring, and program placement. 

The validities were consistent, regardless of whether pictorial or 
verbal stimuli were used to cue writing. The implication is that either 
story starters or topic sentences might well be used because of their 
simplicity and cost efficiency. 

Time allowed for writing in response to stimulus presentation need 
not exceed three minutes. In fact, two minutes might be sufficient if 
the measures are used as often as daily. 

Since counting words written is the most time efficient scoring 
procedure, recording that datum is recommended for students who are 
writing words on cue. For beginning writers, counting letters in correct 
sequence may be an appropriate alternative. 

In sum, a daily 2-3 minute sample of the number of words written by 
a student In response to a story starter or topic sentence reliably 
discriminates between good and poor writers both in and out of learning 
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disabilities progr am s . While the measure seems overly simplistic and 
inelegant in contrast to the more complex measures of written expression 
often used, the economy of the procedures and the technical characteristics 
of the data produced seem ideal for use In routine, systematic formative 
evaluation. The functional utility of the measurement procedures in 
improving services remains to be deteirmined. 
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Table 1 

Correlations Between Scores from a Writing Sample 





Using a 


Picture Stimulus and Scores on the TOWL* 






TOWL 
Subtests 


Mean 

T-unit 

Length 


Mature 
Words 


Large 
Words 


Words 

Spelled 

Correctly 


Total 
Words 
Written 


Rate of 

Words 

Written 


Vocabulary 


.09^ 


.56 


.42^ 


.68 


.65 


.27^ 


Thematic 
Maturity 


.33^ 




. 


« QO 


• DO 




Spelling 


.06^ 


.79 


- fit 


.86 


. 75 


40^ 


Word Usage 


.13^ 


.68 


.47^^ 


.77 


.71 


.35^ 


Style 


,07^ 


.72 


.53^ 


.74 


.66 


.33^ 


Raw Total 


.13^ 


.78 


.56 


.88 


.82 


.36^ 


WLQ 


.03^ 


.67 


.56 


.83 


.77 


.43*^ 


Median 

Correlations .09 


.69 


.53 


.77 


.71 


.35 


* N = 28. 


All correlations are 


significant 


at .001 unless 


otherwise 


noted. 



^ot significant. 
^Significant at -05. 
^Significant at .01. 
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Table 2 

Correlations Between Scores from a Writing Sample Using a 
Story Starter and Criterion Scores on the TOWL* 



TOWL 

O LIU/ L. CO U9 


an 

T-unit 
T.priff t*Vi 


Mature 

rV i. us 


Large 


Spelled 


Words 




11^ 


41^ 


45^" 


45*^ 


41^^ 


Thematic 
Maturity 


.26^ 


.65 


.55^^ 


.60 


.59 


Spelling 


.25^ 


.71 


.72 


.73 


.70 


Word Usage 


.18^ 


.57 


.54 


.57 


.55 


Style 


.21^ 


.66 


.65 


.67 


.63 


Raw Total 


.20^ 


.65 


.66 


.67 


.•63 


WLQ 


.22^ 


.67 


.67 


.64 


.62 


Median 
Correlations 


.20 


.65 


.65 


.64 


.62 



* N = 28. All correlations are significant at .001 unless otherwise 
noted* 

^ot significant. 

^Significant at .05. 

^Significant at .01* 



38 



Table 3 

Correlations Between Scores from a Writing Sample Usin? a 
Story Starter and Scores on Achievement Tests * 



Dependent Sample Duration (Minutes) Criterion 



Measure 


1 


2 


3 


4 


5 


Measure 


Moan T— till"fi- 


• DO 


42^ 


34^ 


41^ 


36^ 


iUWL 


Length 
















.39^ 


.22^ 


.24^ 


.32° 


Stanford 


riacure 




77 
• / / 


* OH 


• 03 




TOTJT 


Words 
















.69 


.68 


.71 


.71 


.72 


Stanford 






* OO 


• OD 


7n 


7n 


iUWL 


Words 
















.42^ 


.57 


.59 


.67 


.68 


Stanford 


Large Words 


.45'^ 


.58 


.70 


.70 


.71 


TOWL 


Modified 
















.44*^ 


.63 


.75 


.76 


.75 


Stanford 


Words Spelled 


.74 


.78 


.79 


.80 


.78 


TOWL 


Correctly 
















.68 


.69 


.69 


.68 


.67 


Stanford 


Total Words 


.73 


.78 


.81 


.81 


.79 


TOWL 


Written 
















.62 


.68 


.65 


.63 


.62 


Stanford 


Mean ^ 














Correlations 


.60 


.63 


' .65 


.67 


.67 





* All correlations are significant at .001 unless otherwise noted. 

Not significant, 
^ Significant at .05. 
*^ Significant at .01. 

^ Mean correlations do not include T-unit data. 
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Table 4 

Correlations Between Scores from a Writing Sample Using a 
Topic Sentence and Scores on Achievement Tests 



Dependv^nt 
Measure 


1 


Sample Duration (Minutes) 
2 3 4 


5 


Criterion 
Measure 


Mean T-unit 


.30^ 


.19^ 


.37^ 


.16^ 


.16^ 


TOWL 


Length 


.15^ 


.03^ 


.20^ 


.09^ 


.07^ 


Stanford 


Mature 


.73 


.73 


.77 


.77 


.76 


TOWL 


Words 


.61 


.63 


.68 


.65 


.60 


Stanford 


Large Words 


.61 


61 


. 70 


.74 


.73 


TOWL 




.42^" 


.44^^ 


.56 


.57 


.55 


Stanford 


Large Words 


.59 


.57 


.62 


.66 


.69 


TOWL 


Modified 


. c ' 
.40 


.42^^ 


.47^^ 


.49^^ 


.51 


Stanford 


Words Spelled 


.67 


.72 


.71 • 


.71 


.73 


TOWL 


Correctly 


.64 


.62 


.60 


.61 


.63 


Stanford 


Total Words 


.66 


.68 


.69 


.68 


.72 


TOWL 


Written 


.62 


.57 


.57 • 


.j)8 


.61 


Stanford 


Mean ^ 














correlations 


.60 


.60 


.64 


.65 


.65 





All correlations are significant at .001 unle otherwise noted. 
^ Not significant. 
^ Significant at .05. 
^ Significant at .01. 

^ Mean correlations do not include T-unit data. 



AO 



Table 5 

Correlations Between Scores from a Writing Sample Using a 
Picture Stimulus and Scores on Achievement Tests 



Dependent 




Sample Duration 


(Minutes) 




wrxuerxon 


Measure 


1 


2 


3 


4 


5 


Measure 


Mean T-unlt 


.60 


.49*= 


.47*= 




. xo 


TOWL 


Length 


.45 


.49*= 


.35^ 


Ota 
.21 


«^a 
.02 


Stanford 


Mature 


.65 


.77 


.86 


• oo 


Q 1 
• o J 


TOWL 


Words 




. 67 


.74 








.52 


.77 


.73 


Stanford 


Large 


.50^ 


.68 


.70 


.70 


. 75 


TOWL 


Words 




.60 


.68 








.50 


.68 


.72 


Stanford 


Large Words 


.39" 


.60 , 


.68 


.68 


.70 


TOWL 


Modified 






.60 








.38 


.52^^ 


.63 


.64 


Stanford 


Words Spelled 


.68 


.71 


.78 


.78 


.80 


TOWL 


Correcxly 


.65 


• .67 


.74 








.77 


.76 


Stanford 


Total Words 


.63 


.72 


.74 


.75 


.75 


TOWL 


Written 


.56 




.67 


.71 






.67 


.70 


Stanford 


Mean 














correlations 


.55 


.66 


.72 


.74 


.73 





All correlations are significant at .001 unless oth^rx^se noted. 
Not significant. 
Significant at .05. 
^ Significant at .01. 
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Table 6 

Correlations Between Various Writing Stimulus Formats 
on Four Behavioral Measures 





Dependent 
Measure 


Story Starter 
and 

Topic Sentence 


Story Starter 
and 

Picture Stimulus 


Topic Sentence 
and 

Picture Stimulus 


Mature 


.75 


.79 


.74 


Words 








Large 


.59 


.55 


.50 


Words 








Words Spelled 


.81 


.87 


.86 


Correctly 








Total Words 


.79 


.86 


.85 



Written 
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Table 7 

Mean Performance of 28 Elementary Students or Behavioral 
Measi'xes of Written Expressicn and Elicited by S tory Starters, 
Topic Sentences, and Picture Stimuli 





Dependent 


Story 


Topic 


Picture 


Measure 


Starter 


Sentence 


Stimulus 


Mature 


10.8 


9.7 


9-8 


Words 








Words Spelled 


40,5 


40.0 


37.4 


Correctly 








Total Words 


44.8 


42.5 


41.1 


Written 









^8 
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Table 8 

Correlations Between Scores from a Writing Sample Using a 
Story Starter and Developmental Sentence Scoring 
Data for Various Sample Durations 



Dependent 
Measure 



Sample Duration (Minutes) 
1 2 3 4 5 



Criterion 
Measure 



Mean T— uni t 
Length 










.29^ 


DSS 


Mature 
Words 


.54 


.66 


.72 


.73 


.74 


DSS 


Large 
Words 


.38 


.44 


.48 


.47 


.47 


DSS 


Large Words 
Modified 


.23^ 


.31^ 


.35 


.35 


.34 


DSS 


Words Spelled 
Correctly 


.67 


.81 


.84 


.87 


.76 


DSS 


Total Words 


.65 


.80 


.84 


.88 


.84 


DSS 


Letters in 

Correct 

Sequence 


.64 


.76 


.78 


.83 


.86 


DSS 


Avp.rage 
Correlation 


.52 


.63 


.67 


.69 


.67 





All correlations are significant at .001 unless otherwise indicated, 
^Significant at .05. 
^Significant at .01. 

'Average correlations do not include T-unit data. 
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Table 9 

Correlations Between Scores from a Writing Sample 
Using a Story Starter and Scores from the 
TOWL for Combined Samples* 



TOWL 
Subtest 


Mature 
Words 


Large 


Words 
Spelled 

\t\j L L ux y 


Total 
Words 


Letters in 
Correct 


Vocabulary 


J6 


.43 




.56 


.63 


Thematic 
Maturity 


.70 


.56 


.60 


.62 


.65 


Spelling 


.75 


.67 


.68 


.68 


.70 


Word Usage 


.74 


.63 


.69 


.70 


.74 


Style 


.63 


.53 


.59 


.61 


57 


Total 


.76 


.63 


.71 


.72 


.75 


^ = 135- 


All correlations are 


significant at 


.001. 





59 
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Table 10 





Performance Means 


of Students 


from Regular 


(N=44) and 






Resource Classrooms (N=90) 


on Dependent Measures 










Standard 






1/163.511X6 


Grouo 


Mean 


Deviation' 


T-Value 


•rrobabllity 


Total 


Resource 


31.9 


19.8 


-5.64 


.001 


Written 


Regular 


53.3 








21.3 






Mature 


Resource 


6.3 


5.1 


-5.52 


.001 


Words 


Regular 


12,4 


6.4 






Words Spelled Resource 


25.8 


19,3 


-6.05 


.001 


Correctly 


Regular 


49.1 


21.9 






Letters in 


Resource 


130.9 


97.0 


-4.68 


.001 


Sequence 


Regular 


227.6 


95.3 







51 
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Table 11 

Correlation Coefficients for ID and Non-LD Groups 
on Scores from Written Samples and the TOWL* 



Group 


Mature 
Words 


Words 
Spelled 
Correctly 


Total 

Words 
Written 


Letters in 

Correct 

Seauence 


TOWL 
Subtest 


LD 




30 


.60 


.70 


Vocabulary 


Non-LD 


.43 


.44 


.38 


.46 




LD 


.64 


.50 


.58 


.68 


Thematic 


Non-LD 


.63 


.47 


.48 


.53 


Maturity 


LD 


.73 


.66 


.69 


.79 


Spelling 


Non-LD 


.67 


.54 


.55 


.57 




LD 


.72 


.63 


.73 


.84 


Word 


Non-LD 


.64 

• 


.56 


.56 


.60 


Usage 


LD 


.60 


.62 


.62 


.62 


Style 


Non-LD 


.52 


.43 


.48 


.43 




LD 


.77 


.67 


.75 


.83 


Subtest 


Non-LD 


.72 


.60 


.61 


.63 


Total 



All correlations significant at .001 level. 



ERIC 



53 
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Table 12 

M^an Grade Level Performance and Standard 
Deviations for Combined Sample on Four 
Behavioral Measures of Written Expression 



N 



Mean 



Standard Deviation 



Total Words Written 
Grade 3 
Grade 4 
Grade 5 
Grade 6 

Mature Words 
Grade 3 
Grade 4 
Grade 5 
Grade G 

Words Spelled Correctly 
Grade 3 
Grade 4 
Grade 5 
Grade 6 



20 
46 
33 
31 

20 
46 
33 
31 

20 
46 
33 
31 



Letters Written in Correct Sequence 



Grade 3 
Grade 4 
Grade 5 
Grade 6 



15 
32 
25 
25 



26.1 
47.6 
49.9 
54.1 

6.1 
10.4 
11.2 
12.3 

22.9 
41.6 
45.3 
49.1 

99.5 
198,1 
242.0 
227.9 



20.1 
20.2 
22.2 
22.5 

5.3 
6.7 
6.2 
6,4 

19.8 
20.5 
23.5 
24.9 

90.3 
93.1 
101.9 
87.9 



ERIC 
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TaMe 13 

Means and Standard Deviations for Resource 
and Regular Students on Total Words Written 



Resource Students 



N 



Mean 



Standard 
Deviation 



Regular Students 
N Mean 



Standard 
Deviation 



Grade 3 
Grade 4 
Grade 5 
Grade 6 



9 
10 
11 
14 



9.0 
34.5 
39.9 
41.6 



9.1 
13.5 . 
21.6 
14.4 



11 
36 
22 
17 



40.1 15.0 
51.1 20.4 
54.9 21.2 



64.4 



23.1 
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Table 14 

Means and Standard Deviations for Resource 
and Regular Students on Mature Words Written 



Resource Students 



N 



Mean 



Standard 
Deviation 



Regular Students 
N Mean 



Standard 
Deviation 



Grade 


3 


9 


1.7 


2.7 


11 


. 9.6 


4.1 


Grade 


4 


10 


5.1 


3.6 


36 


11.9 


6.7 


Grade 


5 


11 


8.5 


5.9 


22 


12.5 


6.0 


Grade 


6 


14 


9.4 


4.0 


17 


14.6 


7.0 
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Table 15 

Means and Standardized Deviations for Resource 
and Regular Students on Words Spelled Correctly 



Resource Students Regular Students 







N 




Standard 
Deviation 


N 


Mean 


Standard 
Deviation 


Grade 


3 


9 


5.;j 


7.2 


11 


36.8 


15.1 


Grade 


4 


10 


28.9 


15.2 


36 


45.1 


. 20.6 


Grade 


5 


11 


32.0 


21.0 


22 


52.0 


22.2 


Grade 


6 


14 


34.0 


17.5 


17 


61.5 


23.5 



^6 



Table 16 

Means and Standard Deviations for Resource and Regular 
Students on Letters Written in Correct Sequence 



Resource Students Regular Students 







N 


Mean 


Standard 
Deviation 


N 


Mean 


Standard 
Deviation 


Grade 


3 


6 


18.3 


29.7 


9 


153.5 


74.0 


Grade 


4 


5 


113.4 


72.9 


27 


213.9 


89.2 


Grade 


5 


8 


208.0 


101.3 


17 


258.1 


101.1 


Grade 


6 


10 


164.8 


55.2 


15 


270.0 


80.9 



57 



10UM 



70.Q0 



6C.77 



50.64 



30. !9 



20«?6 



10.13 



|- 



# 4 ♦ 



♦ 2 • 

0 Q.co p.^o 29.70 



4 • 



• 2 



• 



• • ' ' ' 



}q.(>C ^9,iO 



69.30 74.20 89.10 99 



Total Words Written 



Figure 1 Scattergram illustrating the relationship between Total Words Written 

and Subtest Total from TOWL for 135 subjects. ^ q 

6 J 
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# 



4 




20«>6 



0 



A. 10 10. eO li.!>0 1£.?0 If.OO 21.60 2^.30 27.uO 



Number of Mature VJords Written 



^^g"^e 2 Scattergram illustrating the relationship between Mature Words Written 
and Subtest Total from T0I7L for 135 subjects. 



ERIC 



10. n 



• 7 

7 I 

♦ 

0 ^J.eO lo,?o 



Won 



• 



# 9 # 



• ♦ % 



• 



I V 



^^<iO ^fc.OO 57.60 67.20 76.80 66,^0 

I Spelled Correctly 



96.00 



Figure J Scattergram illustrating the relationship between Words Spelled Correctly 
and Subtest Total from TOITL for 135 subjects. 



ERIC 





n O.^O «1.60 137.^0 lPj»20 i2o.00 27<.fcO 32o.«0 



Letters Written in Correct Sequence 



Scattergram illustrating the relationship between Letters Written in 
Correct Sequence and Subtest Total from TOWL for 135 subjects. 



APPENDIX A 

Examples of Story Starters and 
Topic Sentences 
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Story Starters 

1. Tell a story about the night you were camping in the woods and 
you heard strange noises. 

2. Tell a story about what kind of car you would buy. 

3. Pretend that you are stranded on a tropical island by yourself, 
Tell a story about what happens to you. 

Topic Sentences 

1. Describe your favorite season of the year and tell why. 

2. Write about summer vacation. 

3. Write about what makes you happy. 



EKLC 



APPENDIX B 



Example of How T-Unit Length 
Is Computed for a Written Composition 



Example of T-Unit Scoring 



jpJhen I went on a trip to Texas I rode on an airplaneTJ ^ had a 
really good time^ ^ stayed in a hotel f or three days|^d I went 
parksTJ 



to a lot of 



T-units =» 4 
Words = 34 

Mean T-unit Length = 8*5 




5 



APPENDIX C 

Firm's Undistinguished Word List and An Example of How 
a Written Composition is Scored for Mature Words 



ERIC 



Undistinguished Word Choices 





doesn * t 


house 


no 


take 




VI w J* 1.1 Is 


*A Vi/ W 


11 Vi/ ^ 


ud x^xii^ 


QlJ\J 1.1 U 


H rm p 

Vl WlJl w 


T 

A* 


now 


that 


again 


don ' t 


if 


of 


that ^s 


air 


down 


I'm 


off 


than 


all 


drink 


important 


on 


the 


also 


dumping 


in 


once 


their 


and 


each 


into 


one hundred 


them 


animals 


earth 


is 


open 


then 


another 


either 


it 


or 


there 


any 


else 


its 


other 


they 


anything 


enough 


job 


our 


thing 


are 


even 


iust 


out 


thir es 


around 


every 


keep 


nvPT 

Vi/ V w ^ 


think 




ever von e 


Tell 1 
r^x X X 


nun 

Vi/ W 11 


this 

W> 1 1 ^ o 




evprvthinff 


know 




tune 


asked 


fair 


lake 


Dav 


to 


at 


family 


lakes 


people 


too 


away 


feel 


let 

Xw l<* 


^ w W 


trv 


Had 


few 


llkp 
xx^c 


"Li 1 5IPP 


iin til 

Ull k ^ ^ 




filter 


little 


n 1 an ^ ^ 

Ur XOll k O 




because 


find 


live 


problem 


us 


been 


first 


livine 


put 


use 


bp "FoT'P 


fish 

X X SLL 


lotlff 


rather 


verv 


being 


f ishins 


Xw 


T"B on 

^ wll 


want 


bp"^ PT" 


f ood 


lot 


right 


was 


DJ-g 


for 

JL W ^ 


malf P 


^ X V C ^ 


XJS t* PT* 


bti4 1 A 


^ Vi/ ^ 111 


UlolXXil g 




wav 




f T"OTn 

■t* ^ will 


■man 
mail 


mnnin<y 


we 


bii ^ 


pp t 


many 


<5a±d 


well 


biiv 


ffpt tinff 


LUCL jr 


G amp 


wba t" 


bv 


iv& 

gx V c 


mayb e 


save 


wt Hn 


call 

w a ju -J- 


20 


UlC 


say 


where 


callfed 


SO in 2 


mean 


see 


who 


came 


2ood 


men 


should 


why 


can 


got 


might 


since 


will 


children 


had 


money 


so 


with 


cleaning 


happen 


months 


some 


without 


clear 


happy 


more 


someone 


won * t 


close 


hard 


most 


something 


work 


clos ed 


have 


much 


soon 


worked 




having 


TniiQ t 

1111.19 W 


*3 U i. W w 


wQTWin ff 


could 


he 


my 


Start 


world 


couldn* t 


health 


near 


stay 


would 


day 


help 


need 


still . 


years 


did 


him 


never 


stop 


you 


didn't 




new 


support 


your 


do 


home 


next 


swim 





Example of Mature Word Scoring 



When I went on a ^rlpy to ^exasj I ^rod^ on an ^rplan^ I 
had a ^al^^ good ^lme^ I stayed in a^jteljfor 3 days and 
I went to a lot of /parks 



Mature Words « 



8 
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APPENDIX D 



Example of How a Written 
Composition is Scored for Total 
Words Written 



'J,9 



Example of Total Words Written Scored 



When I went on a trip to Texas I rode on an airplane. I 
had a really good time. I stayed in a hotel for 3 days and 
I went to a lot of parks. 



Total Words Written = 33 
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APPENDIX E 



Example of How Large Words 
are Scored 



Example of Large Words Scores 



When I went on a trip to Texas I rode on an ^^ rplanej I 
had a really good time. I stayed in a hotel for three days 
and X went to a lot of parks. 



Large Words 



EKLC 



APPENDIX F 



Example of How Words Spelled 
Correctly are Scored 



✓ ✓ ✓ 

When I went on a trip to Teksas I road on an aerplane. I 
had a reely good time. I staid in a hotel for 3 days and I went 
to a lot of parks. 



Words Spelled Correctly = 28 



A 

o -4 
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APPENDIX G 



Scoring Categories Used in the 
Developmental Sentence Scoring System 
(Lee & Canter, 1971) 




Category 



Score 



Criteria 



Indefinite Pronouns 
or Noun Modifiers 



1 
2 
3 
4 



it, this, that 

no, some, more, all, etc. 

something, somebody, someone 

nothing, nobody, no one, none 

any , anything , anybody , anyone , 
every, etc. 

both, few, many, each, several, 
most, etc 



Personal Pronouns 



1 
2 
3 
4 
5 

6 
7 



1st and 2nd person (I, me, you, etc.) 
3rd person (he, him, his, she, etc.) 
plural pronouns (we, us, they,, etc.) 
those, these 

reflexive pronouns (myself, yourself, 
etc. ) 

wh-pronouns (who, which, etc.); 
wh-word + infinitive 

(his) own, one, oneself, whichever, etc. 



Main Verbs 1 uninflected verb; copula (is, 's) 

2 is + verb + ing 

3 -s, -ed; irregular past; copula am, 

are, was, were; auxiliary am, are, 
was, were 

4 can, will, may + verb; obligatory do 

+ verb; emphatic do + verb 

5 could, would, should, might + verb; 

obligatory does, did + verb; 
emphatic does, did + verb 

6 must, shall + verb; have + verb + 

en; have (We) got 

7 passive, any tense 

8 have (had) been + verb + ing; modal 

+ h^ve + verb + en; modal + be 
+ verb + ing; other auxiliary 
combinations 



EKLC 



Category 
Secondary Verbs 



Score 

1 
2 
3 
4 



5 
6 



Criteria 

early developing Infinitive complements 

noncompleinentlng Infinitives 

participle, present or past 

early Infinitival complements with 
differing subjects in kemals; 
-later infinitival complements; 
obligatory deletions; infinitive 
with wh-word 

passive infinitival complement 
gerund 



Negatives 1 it, this, that 4- copula or auxiliary 

is, *s + not 

2 can * t , don * t 

3 isn't, won't 

4 copula - negative or auxiliary- 

negative contractions; pronoun- 
auxiliary contraction + not; un- 
contracted negatives 

5 negatives with have; auxiliary have- 

negative contraction; pronoun- 
auxiliary have contraction 



Conjunction 1 and 

2 but 

3 because 

4 so, and so, so that, if 

5 or, except, only 

6 where, when, for, till, since, as, 

etc. + adjective + as, as if, etc.; 
obligatory deletions; optional 
deletions; wh-words + infinitive 

7 therefore, however, whenever, etc. 



Category 



Score 



Criteria 



Interrogative Reversals 1 

2 
3 



reversal of copula 

reversal of auxiliary be 

obligatory do, does, did; reversal of 
modal; tag question 

reversal of auxiliary have; reversal 
with any two auxiliaries 

reversal of three auxiliaries 



Wh-Questions 



1 

2 
3 
4 



who, what, what + noun 

where, how many, how much, etc. 

when, how, how + adjective 

why, what if, how come, how about + 
gerund 

whose, which i which + noun 



EKLC 
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APPENDIX H 



Copy of the Story Starter Used in Study 
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Story Starter Form B 

Date 

Pretend that you can travel anywhere that ID // 

you want. Where would you go? How would 

you get there and what would you do when you got there? 



APPENDIX I 

Copies of the Story Starters 
and Topic Sentences Used in Study II 



ERIC 



Forn B-1 Story Starti'a- Name 



Tell a story abouc the nighfyou were camping in' Che' Woods arid you heard 
strange noises in the woods. 



4. 



^2 

3 TW MWCl MWC2 iwi BW2 fui TU2 SpI 

□□□□□□ □ [ 



Form B-2 Story Starter U^me 

Tell a story about what kind of car you would buy . and ^whac. features it 
would have. ' ' * 



Form B*3 Story Starter 



Name 



Pretend that you are stranded-on a cropical island fay yourself, 
Tell a story about what happens to you. 



S4 



CD I/-- TW HWCl MWC2 ma BW2 TUl TU2 SPl TIME 

^ O □□□□□□ □, □ 



Topic Sentence Name 
Describe your favorice seascr. cf che year and tell why. 



. ^ t:^ , 

O TW IWCl mC2 BWl BW2 TUl TU2 SPl TII^E 

^ □□□□□□□□□ 



Form B-2 Topic Sentence 



Namt: 



Imagine that you could travel anywhere' in the' world" chat you' wanted. 
Where would you go? Why?-- • • - •• — 



CD?/-- ^ MWCl >WC2 BWl BW2 TUl TU2 SP1~"^"tI^ 

□ D □ □ □ D □ □ □ 



Form B~3 Topic Sentence 



Name 



Whac is your favorite Holiday of the year? Give 



your reasons, 



O TW MWCl MWC2 BWl BW2 TUl TU2 SPl T IME 

^ □□□□□□□□□ 



APPENDIX J 



Order of Presentation of Stimulus Materials 



o '8 
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Order for 1/2 of subject sample 

1. Story Starter 

2. Stanford Subtest 

3. Topic Sentence 
4- Picture Stimulus 

5. Test of Written Language 

Order for other 1/2 of subject sample 

1. Topic sentence 

2. Stanford Subtest 

3. Story Starter 

4. Picture Stimulus 

5. Test of Written Language 



a.9 

o 
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APPENDIX K 



Copies of the Story Starters and Topic Sentences Used in Study III 
and an Illustration of How a Written Composition is Scored for 
Letters in Correct Sequence 



00 

o 

ERIC 



Wrice a stcr;/ that begins with: One summer I went on a trip. 



TW MWCl K.:C2 BWl 3W2 TUl TU2 5P1 TIME 

^ □ iZI □□□□□□ CZj ^1 



Form F#-2 Story Starter Kaxne ^ 

VJrite a story that begins- with: One night I v;ent out.sidc when it was vary, .dark 



ERIC 



TO 



f-i rn r 



'[ r 



9S. 



Fora S-3 Stori" Starter Name 



Write a story that begins with: One day something happened which made me. ver-j. 
happy. . 



CD?r" TW hPJCl >WC2 -l BW2 TUl TU2 SPl tI"^ ,> « 



Forr. S-l Topic Sen Lance • ix^^^ 

Write about "Sununer vacation." 



^ ■ D iij □ □ □ □ [HI □ a 



Form 3-2 Topic Sentence 



Write about your neighborhood, where you live, 



TW hlWCl livJCZ BWi BW2 TUl TU2 SPl 



TIME 



1^ □ p □ □ izi □ □ □ □ "-^ 



1°^"' ^-3 Topic Sentence Nam? 



Write about what makes you happy. 



PR?r Mwci MWC2 iwi iw2 rji " ^2 spi time 

^ n m (~i i~] n r~i rn m r"! 



S 2 2 2 r 7. HIT. 

'wHeV I WENT ON A TRIP TO Tg^Y I 'rO/\J^ 

ON AN \E/PLANE^ I HAD A RE^y'' GOOD TIME. 
I IN A HOTEL FOR 3 DAYS AND I 

WENT TO A LOT OF PARKS. 



LETTERS IN CORRECT SEQUENCE = 122 
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Table A 

Oneway ANOVA of Grades 3, 4, 5, and 6 for Dependent Measure, 

Total Words Written^ 



Sum of Meap 

Squares df . Squares F Significance 

Main Effect due 

to Grade Level 9676-9 3 3225,6 6\9 .001 

Residual 44418.7 95 467.6 

Total 54095.7 98 



Table B 

Oneway ANOVA of Grades 3, 4, 5, and 6 for Dependent Measure, 

Mature Words Written 



Sum of Mean 

Squares df Squares F Significance 

Main Effect due 

to Grade Level 416.6 3 138-9 3-5 .019 

Residual 3771,0 95 39,7 

Total 4187.6 98 



Table C 

Oneway ANOVA of Grades 3, 4, 5, and 6 for Dependent Measure, 

Words Spelled Correctly 



Sun of Mean 

Squares df Squares E; Significance 

Main Effect due 

to Grade Level 8116.7 ?. 2705.5 5.2 .002 

Residual 49397.9 95 519.9 

Total .57514.6 98 
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Table D 

Oneway ANOVA of Grades 3, 4, 5, and 6 for Dependent Measure 
Letters Written in Correct Sequence 



Sum of Mean 

Squares df Squares F Sigriificance 

Main Effects due 

to Grade Level 4938.5 3 1646.2 3.5 .018 

Residtial 44607.5 95 469.5 

Total 49546.0 
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Table E 

Two Way ANOVA Effect of Dependent Variable 
Total Words Written on Grade Level (3, 4, 5, or 6) 
and Educational Status (Regular or Resource Student) 



Main Effects 


.Sum of 
Squares 


ii 


Mean 
Squares 


F 


Significance 


Grade Level 


10995.3 


3 


3665.1 


10.4 


.001 


Educational 


Status 8121.3 


1 


8121.3 


23.1 


.001 


Interaction 


1140.7 


3 


380.2 


1.0 


.359 


Residual 


30821.9 


88 


350.2 






Total 


50f.63.7' 


95 
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Table F 





f Dependent Variable Mature 




woras wn^uen on urciae laevex 


(3, 4, 5, 


or 6) and 


Educational 






or Resource 


Student) 






Sum oic 




Mean 






Squares 


df 


Squares 


F 


Significance 


Main Effects 










Grade Level 520.5 


3 


173.5 


5.6 


.001 


Educational Status 650.5 


1 


650.5 


21.0 


.001 


Interaction 58.9 


3 


19.6 


.63 


.594 


Residual 2724.0 


88 









Total 



3925.9 95 



Table G 

Two Way ANOVA Effect of Dependent Variable Words Spelled 
on Grade Level (3, 4, 5, or 6) and Edudational 
Status (Regular or Resource Student) 



Main Effects 

Grade Level 

Educationa] Status 
Interaction 
Residual 



Sum of 
Squares 



10347.9 
11317.2 
810.7 
32762.4 



Mean 
df Squares 



3 
1 
3 

88 



3449 . 3 
11317 . 2 
270.2 



Significance 



9.2 .001 
30.3 .001 
.726 .539 



Total 



54373.4 



95 
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Table H 

Two Way ANOVA Effect of Dependent Variable Letters Written 
in Correct Sequence on Grade Level (3, 4, 5, or 6) 
and Educational Status (Regular or Resource Student) 



Main Effects 

Grade Level 

Educational Status 
Interaction 
Residual 



Sum of 
Squares 



214040.3 
170089.5 
17615.7 
400584.1 



ii 

3 
1 
3 
88 



Mean 
Squares 



Significance 



7.346.7 9.9 .001 
170089.5 23.7 .001 
5871.9 .819 .487 



Total 



630892.5 



95 



ERIC 



106 



PUBLICATIONS 

Institute for Research on Learning Disabilities 
University of Minnesota 



The Institute is not funded for the distribution of its publications. 
Publications may be obtained for $3.00 per document, a fee designed to 
cover printing and postage costs. Only checks and money orders payable 
to the University of Minnesota can be accepted. All orders must be pre- 
paid. 

Requests should be directed to: Editor 

IRLD 

350 Elliott Hall 
75 East River Road 
University of Minnesota 
Minneapolis, Minnesota 55455 



Ysseldyke, J. E. Assessing the learning disabled youngster; The state 
of the art (Research Report No. 1). November, 1977. 

Ysseldyke, J. E. , & Regan, R. R. Nondiscriminatory assessment an d 
decision making (Monograph No. 7). February, 1979. 

Foster, G. , Axgoz';ine, B. , & Ysseldyke, J. Susceptibility to stereo- 
typic bias (Research Report No. 3). March, 1979. 

Algozzine, B. An analysis of the disturbingness and acceptability of 
• behaviors as a function of diagnostic label (Research Report No. 4) . 
March, 1979. 

Algozzine, B., & McGraw, K. Diagnostic testing in mathematics; An 
extension of the PIAT? (Research Report No. 5). March, 1979. 

Deno, S. L. A direct observation approach to measuring classroom 
behavior: Procedures and application (Research Report NoT~6) • 
April, 1979. 

Ysseldyke, J. E., & Mirkin, P. K. Proceedings of the Minnesota round- 
table conference on assessment of learning disabled children 
(Monograph No. 8). April, 1979. 

Somwaru, J. P. A new approach to the assessment of learning disabilities 
(Monograph No. 9). April, 1979. 

Algozzine, B., Forgnone, C, Mercer, C. D., & Trifiletti, J. J. Toward 
defining discrepancies for specific learning disabilities: An 
analysis and alternative's (Research Report No. 7). June, 1979. 



Note: Monographs No. 1-6 and. Research Report No. 2' are not available 
for distribution. These documents were part of the Institute's 
1979-1980 continuation proposal, and/or are out'of print* 



107 



Algozzine, The disturbing child: A validation report (Research 

Report No* 8). June, 1979. 



Ysseldyke, J. E. , Algozzine, B,, Regan, R. , & Potter, Technical 
adequacy oi t ests used by professionals in simulated decision 
making (Research Report No, 9). July, 1979. 

Jenkins, J. R. , Deno, S. L., & Mirkln, P. K. Measuring pupil progress 
toward the lea^^t restrictive envirc^nment (Monograph No. 10). 
August, 1979. 

Mirkln, P. K., & Deno, S. L. Formative evaluation in the classroom: An 
a T^proach to improving instruction (Research Report No. 10). August, 
11379. 

Thurlow, M. L., & Ys?)eldyke, J. E. Current assessment and decision-making 
practices in model programs for the learning disabled (Research Report 
No. 11). August, 1979. 

Deno, S. L., Chiang, B., Tindal, G., & Blackburn, M. Experimental analysis 
of program components; An approach to research in CSDC's (Research 
Report No. 12). August, 1979. 

Ysseldyke, J. E., Algozzine, B., Shinn, M. , & McGue, M. Sltnilarltles and 
differences between underachlevers and students labeled learning 
disabled; Identical tvlns with different mother s (Research Report 
No. 13). September, 1979. 

Y?seldyk'si, J., & Algozzine, R. Perspectives on assessmeni: of learning 
disabled students (Monograph No. 11). October, 1979. 

Poland, S. F., Ysseldyke, J. E., Thurlow, M. L. , & Mivkin, P. K. Current 

assessment and decision-making practices in school settings as reported 
by directors of special education (Research Repott No. 14). November, 
1^79. 

McGue, M. , Shinn, M. , & Ysseldyke, J. Validity of the Woodcock-Johnson 

psycho-educational battery with learning disabled students (Research 
Report No. 15). November, 1979. 

Deno, S., Mirkln, P., & Shinn, M. Behavioral perspectives on the assess- 
ment of learning disabled children (Monograph No. 12). November, 1979. 

Sutherland, J. H. , Algozzine, B., Ysseldyke, J. E., & Young, S. What 

can I say after I say LP ? (Research Report No. 16). December, 1979. 

Deno, S. L., & Mirkin, P. K. Data-based lEP development; An approach 
to substantive compliance (Monograph No. 13). December, 1979. 

Ysseldyke, J., Algozzine, B., Regan, R. , & McGue, M. The influence of 

test scores and naturally-occurring pupil characteristics on psycho- 
educational decision making with children (Research Report No. 17). 
December, 1979. 



Algozziue, B., & Ysseldyke, J. E. Decision makers' prediction of 

students' academic difficulties as a function of referral informa- 
tion (Research Report No. 18) • December, 1979. 

Ysseldyke, J. E., & Algozzlne, B. Diagnostic classification decisions 
as a function of referral information (Research Report No. 19). 
January, 1980. 

Deno, S. L. , Chiang, B., Mirkin, P. K., & Lo\irry, Relationshi ps 

among simple measures of reading and performance on standardized 
achievement tests (Research Report No. 20). January, 1980* 

Deno, S. L. , Lowry, L., Mirkin, P. K., & Kuehnle, K. Relationships 

among simple measures of spelling and performance on standardized . 
achievement tests (Research Report No. 21). January, 1980. 

Deno, S. L. , Marston, D. , & Mirkin, P. K. Relationships among simple 
measures of written expression and performance on standardized 
achievement tests. (Research Report No. 22). January, 1980. 

Mirkin, P. K. , Deno, S. L. , Tindal, G., & Kuehnle, K. Formative evalua- 
tion: Continued development of data utilization systems (Research 
Report No. 23). January, 1980. 

Deno, S. L. , Robinson, S., Evans, P., & Mirkin, P. K. Relationships 

among class ^' oom observations of social adjustment and sociometric 
rating scal .s':^ (Research Report No. 24). January, 1980. 

Thurlow, L. , & Ysseldyke, J. E. Factors influential on the psycho- 

educat:ional decisions reached by teams of educators (Research Leport 
No. 25). February, 1980. 

Ysseldyke, J. E., & Algozzine, B. • Dia^'ostic decision making in indivi- 
duals susceptible to biasing information presented in the referral 
case folder (Research Report No. 26). March, 1980. 

Thurlow, M. L., & Greener, J. W. Preliminary evid<^nce on information 

considered useful in instructional planning (Research Report No. 27). 
March, 1980. 

Ysseldyke., J. E., Regan, R. R. , & Schwartz^ S. Z. The use of technically 
adeq ua te tests in psychoeducational decision making (Research Report 
No. ?/6). April, 1980. 

Richey, L., Potter, M. , & Ysseldyke, J. Teachers^ expectations for the 
siblings of learning disabled and non-learning disabled students : 
A pilot study (Research Report No. 29). May, 1980. 




1V9 



